Automatic Training of a Neural Net for Active Stereo 3D Reconstruction

نویسندگان

  • Jeremiah J. Neubert
  • Anthony Hammond
  • Yongtae Do
  • Yu Hen Hu
  • Nils Guse
چکیده

This paper addresses the problem of recovering 3D geometry using an active stereo vision system. Calibration procedures can be adapted to the active stereo conguration, however, considerable e ort is required to accurately model and calibrate the kinematics to avoid poor reconstruction. In the active stereo case there will also be errors due to uncertainty in the kinematics of the system. In addition, data collection needs to be automated because active stereo requires signi cantly more information for calibration. We present a biologically inspired neural network trained to determine the mapping between 3D geometry and stereo image points. To train the network, we have developed a system to automatically collect accurate calibration data. We compare the reconstructed 3D geometry obtained using a kinematic model based approach with our neural network approach.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Automatic 3D Point Set Reconstruction from Stereo Laparoscopic Images using Deep Neural Networks

In this paper, an automatic approach to predict 3D coordinates from stereo laparoscopic images is presented. The approach maps a vector of pixel intensities to 3D coordinates through training a six layer deep neural network. The architectural aspects of the approach is presented and in detail and the method is evaluated on a publicly available dataset with promising results.

متن کامل

Artificial Parietal Cortex Neurons for 3d Reconstruction

A neural network is used for three-dimensional (3D) reconstruction of a point from a pair of images obtained with an active stereo system. Our active stereo system describes the position of a point with eight parameters: two pan angles, two tilt angles, and two-dimensional coordinates of the projected point in each image. Three-dimensional (3D) reconstruction consists of learning the function w...

متن کامل

A multi-scale convolutional neural network for automatic cloud and cloud shadow detection from Gaofen-1 images

The reconstruction of the information contaminated by cloud and cloud shadow is an important step in pre-processing of high-resolution satellite images. The cloud and cloud shadow automatic segmentation could be the first step in the process of reconstructing the information contaminated by cloud and cloud shadow. This stage is a remarkable challenge due to the relatively inefficient performanc...

متن کامل

Roof Type Selection Based on Patch-based Classification Using Deep Learning for High Resolution Satellite Imagery

3D building reconstruction from remote sensing image data from satellites is still an active research topic and very valuable for 3D city modelling. The roof model is the most important component to reconstruct the Level of Details 2 (LoD2) for a building in 3D modelling. While the general solution for roof modelling relies on the detailed cues (such as lines, corners and planes) extracted from...

متن کامل

Camera Arrangement in Visual 3D Systems using Iso-disparity Model to Enhance Depth Estimation Accuracy

In this paper we address the problem of automatic arrangement of cameras in a 3D system to enhance the performance of depth acquisition procedure. Lacking ground truth or a priori information, a measure of uncertainty is required to assess the quality of reconstruction. The mathematical model of iso-disparity surfaces provides an efficient way to estimate the depth estimation uncertainty which ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2001